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Abstract 

The purpose of this paper is to give a convergence analysis of the 
iterative scheme: 

< = qu 5 n _ x + (1 - q)T-^K*f 5 , u* = 0, 

where T := K*K, T a := T + al, q e (0, 1), a n := a q n , a > 0, 
with finite-dimensional approximations of T and K* for solving stably 
Fredholm integral equations of the first kind with noisy data. 
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1 Introduction 

We consider a linear operator 



where K : L 2 [a, b] — ► L 2 [a, b] is a linear compact operator. We assume that 
k(x,z) is a smooth function on [a, b] x [a, b]. Since K is compact, the prob- 
lem of solving equation (fT]) is ill-posed. Some applications of the Fredholm 
integral equations of the first kind can be found in [3], [5], [6]. There are 
many methods for solving equation (fT]): variational regularization, quasi- 
solution, iterative regularization, the Dynamical Systems Method (DSM). 
A detailed description of these methods can be found in [3], [5], [6j. In 
this paper we propose an iterative scheme for solving equation (pQ) based 
on the DSM. We refer the reader to [5] and [6] for a detailed discussion of 
the DSM. When we are trying to solve ([T]) numerically, we need to carry 
out all the computations with finite-dimensional approximation K m of the 
operator K, linim^oo \\K m — K\\ = 0. One approximates a solution to ([I]) 
by a linear combination of basis functions v m (x) := 'Y^iLx Q < Pj( x )j where 
Cj™^ are constants, and 4>i{x) are orthonormal basis functions in L 2 [0, 1]. 
Here the constants can be obtained by solving the ill-conditioned linear 




a < x < b. 



(1) 
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algebraic system: 

m 

^(KrnjijCj = g h i = 1,2,... ,m, (2) 
i=i 

where := k(x, s)<pj(s)ds(f)i(x)dx, 1 < i,j < m, and ft := 

f f(x)<f>i(x)dx. In applications, the exact data / may not be available, 
but noisy data f$, \\fs — f\\ < 5, are available. Therefore, one needs 
a regularization method to solve stably equation ([2]) with the noisy data 
gf := f? fs(x)<fii(x)dx in place of ft. In the variational regularization (VR) 
method for a fixed regularization parameter a > one obtains the coeffi- 
cients Cj" 1 ^ by solving the linear algebraic system: 

m 

<i m) +Y.^ K *m K m)i j C,f l) =gf, i = l,2,...,m, (3) 

where 

(K^Km)^ := / / k(s,x)ct>i(x) / k(s,z)4>j(z)dzdsdx, 

J a J a J a 

11/ — < <5> and k(s,x) is the complex conjugate of k(s,x). In the VR 
method one has to choose the regularization parameter a. In [4] the New- 
ton's method is used to obtain the parameter a which solves the following 
nonlinear equation: 

F(a) :=\\K m ( m - g 5 f = (CS) 2 , C > 1, (4) 

where Cm = ifll + K^Km) -1 K^g s , and is the adjoint of the operator 
K m . In [2] the following iterative scheme for obtaining the coefficients 
is studied: 

Cim = QCLi,m + ^-Q)T- n ] m K* m g 5 , d s = 0, a n :=a q n , (5) 

where «o > 0, q £ (0, 1), 

T a , m :=T^+aI, := K* m K m , a > 0, (6) 

and / is the identity operator. Iterative scheme ([5]) is derived from a DSM 
solution of equation (fTJ) obtained in [5] p. 44]. In iterative scheme ([5]) adaptive 
regularization parameters a n are used. A discrepancy-type principle for 
DSM is used to define the stopping rule for the iteration processes. 
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The value of the parameter m in (J3J and © is fixed at each iteration, 
and is usually large. The method for choosing the parameter m has not been 
discussed in [2]. In this paper we choose the parameter m as a function of 
the regularization parameter a n , and approximate the operator T := K*K 
(respectively K*) by a finite-rank operator T^ m ) (respectively K^): 

lim \\T (m ^ - T\\ = 0. (7) 

m— >oo 

Condition ((TJ) can be satisfied by approximating the kernel g(x, z) of T, 

6 



g(x,z):= / k(s,x)k(s, z)ds, (8) 

J a 

with the degenerate kernel 

m 

g m (x, z) := Wik(si,x)k(si, z), (9) 
j=i 

where {sj}^ are the collocation points, and Wi,l < i < m, are the quadra- 
ture weights. Quadrature formulas Q can be found in [I]. Let be a 
finite-dimensional approximation of K* such that 

lim \\K*-K* II = 0. (10) 

m— >oo 

One may choose = P m K*, where P m is a sequence of orthogonal pro- 
jection operators on L 2 [a,b] such that P m x ->iasm-t oo, Vx G L 2 [a, 6]. 
We propose the following iterative scheme: 

u n,m n = 1 u n-l,mn-i + (1 — l)^an,m n ^m, n fs > u 0,m Q = 0) (H) 

where a n := a <7 n , a > 0, q <E (0,1), H/s - /|| < 5, T a>m is defined in 
([6]) with r( m ) satisfying condition ((TJ), ilC^ is chosen so that condition (fTUj) 
holds, and m n in (llip is a parameter which measures the accuracy of the 
finite-dimensional approximations T^" 1 ™) and K^ n at the n— th iteration. 
We propose a rule for choosing the parameters m n so that m n depend on 
the parameters a n . This rule yields a non-decreasing sequence m n . Since 
m n is a non-decreasing sequence, we may start to compute T~^ mn Km n fs 
using a small size linear algebraic system 

T an , mn g S = K^ n f s , (12) 

and increase the value of m n only if G rhnin > C5 e , C > 2, e G (0, 1), where 
G n ,m n is defined below, in ((731) . Parameters m n may take large values for 
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n <n$, where n$ is defined below, in (|73p . The choice of the parameters mj, 
i = 1,2, . . ., in (fTT|) . which guarantees convergence of the iterative process 
(jlip . is given in Section 2. We prove in Section 3 that the discrepancy- 
type principle, proposed in [2], with T^" 1 ) and in place of T and K* 
respectively, guarantees the convergence of the approximate solution mn 
to the minimal norm solution of equation ([I]). Throughout this paper we 
assume that 

ylM(K), (13) 

and 

Ky = /, (14) 
where M{K) is the nullspace of K. 

Throughout this paper we denote by the operator approximating K*, 
and define 

T a :=T + aI, T := K*K, (15) 

where a = const > and I is the identity operator. 

The main result of this paper is Theorem 13,71 in Section 3. 



2 Convergence of the iterative scheme 

In this section we derive sufficient conditions on the parameters im, i = 
1,2, ... , for the iterative process (jlip to converge to the minimal-norm so- 
lution y. The estimates of the following Lemma are known (see, e.g., [6]), 
so their proofs are omitted. 



Lemma 2.1. One has: 



and 



for any positive constant a. 



K'W < I (16) 



While T a is boundedly invertible for every a > 0, T a>m may be not 
invertible. The following lemma provides sufficient conditions for T a ,m 

to be 

boundedly invertible. 
Lemma 2.2. Suppose that 

\\T - T (m) || < ea, a = const > 0, (18) 
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where e 6 (0, 1/2]. TTien #ie following estimates hold 



and 



Proof. Write 



T _i < - 

a 



IT -1 if* 1 1 < 



\T-lK*K\\ < 2. 



/ + 77 1 (T^ m ) — T) 



T — T 

J -a,m — ± a 

It follows from ((ISJ) and (JT5J> that 

|| r -i( T M _ T )|| < lir-^IIKT^) -T)|| < e < 1. 



(19) 
(20) 

(21) 
(22) 

(23) 



Therefore the operator I + T a 1 (T^ rr ^ — T) is boundedly invertible. Since T a 
is invertible, it follows from (122ft and (1231) that T a m is invertible and 



I + T-^T^ -T) 



T. 



-i 



(24) 



Let us estimate the norm ||T ar ^||. We have < e < 1/2, so 



I + T- 1 (T { - m ^ -T) 



< 



1 



1 



1- llT^rM -T)\\ ~ 1-e 
This, together with (fTBj) and (f24l) . yields 

2 



< < 2. (25) 



-i-i I 

- a,m I 



(26) 



Thus, estimate (|T9j) is proved. To prove estimate (|20j) . write 

-i 



T" 1 if* 



I + T~ 1 (T (m) -T) 
Using estimates (|25|) and (fT7|l . one gets 



IT 1 if*. 



IT" 1 if* 1 1 < 

I a,m II — 



1 



which proves estimate (J20J). Let us derive estimate (I2ip . One has: 



T _1 if* if 



i + r~ 1 (r^ - t) 



rr 1 if*if. 
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Using the estimates HT" 1 ^ < 1 and ((25]), one obtains 



\\T-"T\\ < — <2 



1 - e 



Lemma 12.21 is proved. 



□ 



Lemma 2.3. Let g(x) be a continuous function on (0, oo), c > and q £ 
(0, 1) be constants. If 



lim g(x) = g(0) := g , 



then 

Proof. Let 
and 

Then 



n-l 



lim V {q^i- 1 - q n -i) g(cq 3+1 ) = g . 
j=0 



w 



(«) ._ n n-j _ „n+l-j (n) 



1-1 



i=i 



(27) 

(28) 

(29) 
(30) 



\F n+1 (n)-g \ < \F l (n)\ + 



^2w] g(cq 3 ) - go 

3=1 

Take e > arbitrary small. For sufficiently large 1(e) one can choose n(e), 
such that 

\F m (n)\ < |, Vn>n(e), 

because linin^oo q n = 0. Fix I = 1(e) such that \g(cq J ) — go\ < § for j > /(e). 
This is possible because of (|27l) . One has 



\F m (n)\ <-, n> n(e) 



and 



^ w^g^q 3 ) -g 



< ™? } \9(cq j )-9o\ + \ £ ^-illSDl 



< | + l5ok n ^ (e) < e, 
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if n is sufficiently large. Here we have used the relation 



5>f } = 1 - <f 

3=1 

Since e > is arbitrarily small, relation (I28p follows. 

Lemma 12.31 is proved. □ 
Lemma 2.4. Let 

u n = qun-l + (1 - q)T~^K*f, u = 0, a n :=a q n , q£(0,l). (31) 
Then 

n-l 

IK - y\\ < q n \\y\\ + £ {q n - j ~ l ~ q n ~ j ) a j+ i\\T-l iy \\, Vn > 1, (32) 
i=o 

and 

\\un — y\\ — > as n — > oo. (33) 
Proof. By induction, we obtain 

n-l 

^ = J>f T-^if*/, (34) 



j=0 



where tu^ = q n J 1 — q n This, together with the identities -fTy = /, 
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and 



yield 



T~ l K*K = T~ l (K*K + al - al) = I - aT' 1 (35) 



5>W = l-g», (36) 

5=0 



n-l 
j=0 

n— 1 n— 1 

E(n) \ (n) 

j=0 i=0 

n-l 

n \ (n) ™_l 

j=0 



S 



Thus, estimate ([32]) follows. To prove ([33]) . we apply Lemma [2T3l with g(a) := 
a\\T~ 1 y\\. Since y _L M(K), it follows from the spectral theorem that 

f°° a 2 

lim g 2 (a) = lim / - — ■ — -^d(E s y,y) = \\PjV(K)y\\ 2 = 0, 

where E s is the resolution of the identity corresponding to K*K, and P is 
the orthogonal projector onto N(K). Thus, by Lemma [231 ([33]) follows. 
Lemma 12.41 is proved. □ 

Lemma 2.5. Let u n and a n = a^q n , ao > 0, q G (0, 1) be defined in (j31j) . 
^a,m defined in ([6]), mj 5e chosen so that 

\\T-T^\\<^, l<i< n , (37) 

and 

u n ,m n = qu n -i, mn _ x + (1 - q)T- n ] mn K^ n f, u , mQ = 0. (38) 

Then 



n,m n 



i n \\ < q n \\y\\ + \\y - u n \\ + 2 wf+i 

3=0 

n—1 

+ 2 E tu i+i a i+i|l T <yiifll' 

3=0 



(39) 



where are defined in ([29]) . 

(n) 

Proof. One has w\ > 0, < q < 1, and 
n-1 

E(V0 i n i 

= 1 — 9—^1; os n — > oo. 

i=o 

(n) 

Therefore one may use for large n as quadrature weights. To prove 



inequality ([39]) . the following lemma is needed: 
Lemma 2.6. Let u n ^ mn be defined in (j38p . TTien 

n-l 
3=0 

where Wj are defined in (|29p . 
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Proof. Let us prove equation (|40p by induction. For n = 1 we get 
ui,mi = <?«o + (i - q)T~] mi K^j = (1 - q^-^K^j 

so equation PU|) holds. Suppose equation holds for 1 < n < Then 

«fe+l,m fc+ i = gWfc.m* + (1 - Q , ) r a^+ x ,m fc+ i-^m fe+x / 
fc-1 

,(fc) nn-1 



3=0 

k-l 

(fc+l) T _i K * , (fc+1) i * , 



i=0 
fc 

= V ) « (k+1) r 1 f 

/ / - t aj+i,mj + i- £V mj + i < / ■ 

i=0 

Here we have used the identities qtVj = Wj and 1 — q = Wj ■ Equation 
(gOJ) is proved. □ 



By Lemma |2.6( one gets: 
n-l 



n-l 



-~h+h, 



where 



n-l 



and 



h ■= E^\T-| limj+1 (^ +1 ^-T( m ^) +T^)y, 

j=0 
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We get 



n-l 



(n) 



j=0 

^ ,. 

j=0 
n-l 



E 



w 



(n) 



a J+ i,mj + iV- £V mj + i- IV /J/ ^ J -Oj + i,mj+i- 1 f 

(K* mj+1 K-T^)y-a j+1 T-l u 



-i 



-a j+1 ,m j+1 v 



j=0 

+ y - g n y 

n-l 

E (n) „_i ,„* _ ( m ), 

3=0 
n— 1 

- E «'i+i i+i( r «"; + i,m J - +1 - T'l, + T'l^y + y-q n y 

3=0 

= </-<A/ + E ^%T-l 1;mj+1 (K* mj+1 K - T^)y 

3=0 

n— 1 

" E w i+i [ a 3 + iT^ +1 , mj+1 (T ~ T^))T-^y + a j+1 T-l lV 

3=0 



Therefore, 



n-l 



h + h = V - u n - q n y + ^ i+ i K ~ T {m]+l) )v 



3=0 



n— 1 



3=0 



(42) 
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Applying the estimates \\T^ -T\\ < § and HT"^!! < ~ in (03]), one gets 

n-l 

< q n h\\ + 

.(») IIT-1 



3=0 

n-l 

i=o 

n— 1 

,(») 



+ E^+iiiw^,^^ - r(mi+l) )^i l2 /ii 

3=0 

n-l 
3=0 

n— 1 

+ E^" ) ill T 4 1 ^ + illll(^ +1 ^- T(mj+l) )yll («) 

n-l 

+E w j+Wiii^i 1 ,« J+ iiiii r - r(By+l) iiii :z ^xyii 

3=0 

n-l 

< <T||y|| + h - u n \\ + E ^Wil|r->|| 

j=0 

n-l 

+ E^+l IK^, +1 ^ - T^+i)) y || 

i=o 



n— 1 



Lemma 12.51 is proved. □ 
Lemma 2.7. Under the assumptions of Lemma \2.5\ if 

\\K* mn -K*\\<^ (44) 



then 

Hi/... ... — i/ 5 II < ; . 

1 — g 3 / 2 yfq^fa 



u -u 5 ||<— ^ — (45) 

u n,m„ "ri,mnll — i _s/9 - '' 
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Proof. We have 



S 



! n,m n u n,m n ~ < l( u n-l,m„^ 1 u n—l,m„-i ) + 0- l)^a„,m n ^m n (f fs) 
= q{u n - ltmn _ 1 - t4-l,mn_x) + (! ~ l) T a^m n { K *m n ~ K *){f ~ Is) 

+ (l-q)T-) mn K*(f-f s ). 

(46) 



Since ||/ - f 5 \\ < 5, \\T-] mn K*\\ < ^fc and \\K* mn - K*\\ < it follows 
that 

n,m n — u n ,m n II — l\\ u n-l,m n -i ~ u n-l,m n -i II + ^ — -=. (47) 



"n,m n u 'n,m n I 



Let us prove estimate ([43]) by induction. Define H n := 
and h n := 2^J^. For n = we get if = < y^f/a/io- Thus gSD holds. 
Suppose estimate (j45|) holds for < n < A;. Then 



H k +i < qH k + h k < q - _^ 3/2 ^fc + % = f g ^ _^3/2 + 1 ) /;/ 



1 fe fc ^ v 7 ^ 

Here we have used the relation 



(48) 



1 - o^/ 2 h k +-\ 1 - o^ 2 



hk+1 2 7ffc 

Lemma 12.71 is proved. □ 
The following theorem gives the convergence of the iterative scheme (llip . 
Theorem 2.8. Let u & nrrin be defined in (jllj) . 6e chosen so that 

|| T _ r (mO|| < a ./ 2) (50) 

||r^)-^K||<af, (51) 

||^-X*|| < (52) 
and n,5 satisfies the following relations: 

lim n,5 = 00, lim — — ^ = 0. (53) 



5^0 <5^o Janj 



Then 



J™ K,, mna - y|| = 0. (54) 
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Proof. We have 



I U u n,m„\\ — III! u n\\ + \\ u n U ntTnn \\ + ||u nj . mjI ^r^nvjl' (^5) 



From (|39p and estimate (|5ip we get 

rt— 1 n— 1 

||«n,mn- u n|| < Q ,n ||2/|| + l|y-'"n||+2 ^ U^Ctj+i ||y||+2 ^ W^aj+i H?^^!. 

3=0 j=0 

(56) 

This, together with Lemma 12.71 implies 



i,-< m j<2(y ( „) + p _ i_) 



(57) 



where 



n— 1 n— 1 

II //II -I- II // — // .. II 4- 



J ( n ) — II^H ~f- 112/ — '"rill H- ^-+i«-y-+-a ^^^^i+x^M-a [l^k^+iX/lh (58) 

j=0 j=0 

and u>j n ^ are defined in (|29|) , Since y _L //(A), it follows that 

limo^lT-Vll 2 = / f , , 2 d{E s y,y) = \\P M {K)y\\ 2 = 0, 
a— »U [a + s) 

where E s is the resolution of the identity of the selfadjoint operator T, 
and Ptf(K) is the orthogonal projector onto the nullspace M{K). Applying 
Lemma [2731 with g{a) := a\\T~ y\\, one gets 

n-l 

^E^TWill^ylHo. (59) 
3=0 

Similarly, letting 5(a) := a\\y\\ in Lemma 12. 3] we get 

n-l 

lim 2VJ" ) 1 a i+1 ||y|| = 0. (60) 
n— »oo * — » J r 
3=0 

Relations ([59]) and (|60|) . together with Lemma [2~4l imply 

lim J(n) = 0. (61) 



If we stop the iteration at n = n$ such that assumptions (|53j) hold then 

lim^o J(ns) = and lim^o j^- = 0. Therefore, relation (|54"|) is proved. 

This proves Theorem 12.81 □ 
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3 A discrepancy-type principle for DSM 

In this section we propose an adaptive stopping rule for the iterative scheme 
(jlip . Throughout this section the parameters rrii, % = 1, 2, . . . , are chosen 
so that conditions ([50|)-([52]) hold, 



\\Q -Q {m%) \\ <ea { , eG (0,1/2], a i = a q i , a = const > 0, (62) 
where 

Q := KK*, (63) 

and Q( m ) is a finite-dimensional approximation of Q. One may satisfy con- 
dition (|62p by approximating the kernel q(x,s) of Q, 



q(x,s)= / k(x, z)k(s, z)dz, (64) 

J a 

with 

m 

<? m (x, s) = } j ~/ik(x, Zi)k(s, Zi), (65) 
i=i 

where 7j, £ = 1, 2, . . . , m, are some quadrature weights and Zi are the collo- 
cation points. 

Lemma 3.1. 

HOI < ~ a (66) 

and 

\\Q- X K\\ < -±=, (67) 
2^/a 

/or any positive constant a. 

Proof. Since Q = Q* > 0, one uses the spectral theorem and gets: 

IIQa 1 !! = sup— j— < -. 

s>0 s + a a 
Inequality (|67p follows from the identity 

Q- 1 K = KT~\ T:=K*K, T a :=T + aI, (68) 
and the estimate 

H^t- 1 !! = lic/r^r- 1 !! < Wt^t^w = su P ^ < -L (69) 

where the polar decomposition was used: K = UT 1 / 2 , U is a partial isome- 
try, ||J7|| = 1. Lemma 13. H is proved. □ 
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Lemma 3.2. Suppose m is chosen so that 

||Q-QM||<ea, e 6 (0,1/2], a > 0. (70) 
Then the following estimates hold: 

WQainW < ~, (71) 
a 

\\Q^ m K\\ < \ (72) 
V" 

Proof of Lemma [3,21 is similar to the proof of Lemma [22] and is omitted. 

We propose the following stopping rule: 
Choose ns so that the following inequalities hold 

G ns , mns < C6 £ < G n , mn , 1 < n < n 5 , C> 2, e 6 (0, 1), (73) 

where 

G n ,m n = qG n ^i^ mn _ 1 + (1 - q)a n \\ Q^ nj mn fs || , 

Go,m = °' Ci /mi > C5 £ , a n = qa n -i, a = a = const > 0, 

and 

Qa,m ■= Q (m) + al. (75) 

The discrepancy-type principle (|73|) is derived from the following discrepancy 
principle for DSM proposed in [7] [8]: 



e ^a(s)\\Q^ s) f s \\ds = C8, C> 1, (76) 

where ts is the stopping time, and we assume that 

a{t) > 0, a{t) \ 0. 

The derivation of the stopping rule (|73p with Q^ m "> = Q is given in [2j. Let 
us prove that there exists an integer n$ such that inequalities ([73]) hold. 
To prove the existence of such an integer, we derive some properties of the 
sequence G n ^ mn defined in (f74]l . Using Lemma [3.2[ the relation Ky = /, 
and the assumption \\fs — f\\ < 6, we get 

an\\Q^,mJs\\ < anWQalmMs ~ f)\\ + «n||Q^ m „/|| 
< 25 + 2y / a^||y||, 
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where estimates ([71]) and ([72]) were used. This, together with ([73]) . yield 

Gn,m n — QGrn— X,m n — 1 

+ (1 - g)2<5 + (1 - g)2^/a^||y||, (78) 

so 

-25) + (1 - q)2 y /q y /a^\\y\\, (79) 
where the relation a n = ga n _i, ao = Qo = const > 0, was used. Define 

*n := G nimn - 25, (80) 

where G n ^ m is defined in ([71]) . and let 

^ n :=(l-g)2V^||y||. (81) 

Then 

*n <4#n-l + \/#n-l- (82) 
Lemma 3.3. // ([80]) and ([EE]) hold, then 



*n < n > 0. (83) 

Proof. Let us prove this lemma by induction. For n = we get 

= -25 < 

Suppose estimate ([83]) is true for < n < k. Then 

^k+i < q^k + \fqipk < z Q r- ^k + \/qipk = , ^ ' ^k 

J~q Vfc \/q i i 

^fc+i < z -—ipk+i = z i=.Wk+i- 



Here we have used the relation 

ipk _ (i - q)^Vak\\y\\ _ \/ofc _ y/ak 



(84) 



(85) 



V^+i (1 - q)2 y /a k+ i\\y\\ ^a k+ i yfqak \fq 
Thus, Lemma [3731 is proved. □ 
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By definitions (f80|) , (f8Tj) , and Lemma 13,31 we get the estimate 



G ntmn < 25 + - -(1-^)2^112/11, n>0, (86) 

1 - v/9 

so 

limsupG n , mn < 2<5 (87) 

n^oo 

because lim^-^ a n = 0. 

Since G\ jmi > C5 £ , C > 2, e 6 (0, 1) and limsup^^^ G„ im „ < 2(5, it follows 
that there exists an integer such that inequalities (|73p hold. The unique- 
ness of the integer n$ follows from its definition. 



Lemma 3.4. If ng is chosen by the rule (|73p . then 

(5 



as <5 -» 0. 



Proof. From the stopping rule (f73l) and estimate (i86j) we get 

C<5 £ < GVi.m^-i < 2(5 + J^^ 1 " ?) V«^llyll- (89) 
This implies 

V^^i \ l -y/v\P ~ 2 W 

so 

(5 <5 1_£ 
< —rr, PTTT^ - ff)2| y| -» as (5 -»■ 0. (91) 

Lemma 13.41 is proved. □ 
Lemma 3.5. If ng is chosen by the rule (jT3l) . i/ien 

lim rig = oo. (92) 
5^0 



Proof. From the stopping rule (|73j) we get 



gC(5 e + (1 - g)an a ||Qa 7l 1 5 ,m„ 5 /<5|l < flGrn-l.mnj-i + (1 - WQaJi^mnJs II 

(93) 
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This implies 

< a ns \\Q-^ mn J 5 \\ < C5 £ -» as 5 -» 0. (94) 

Note that 

< a^HQonV 5 '! - a ns\\(Qal, ~ Qal x ,m ng ) fs 1 1 + «n« 1 1 Qa^ ,m„, /* 1 1 



a "i IIQa„, (Qa„ s ,m„ s Qa n& )Qa nx ,m„, /<5|| + a n s \\Qa nx ,m n Js\\ 



= an e \\Qan s (Q {mns) - Q)Qa' 6 ,m n Js\\ + ^J^r^MI 

< a n JQ- 1 ||||g< m «<> -QIIIIQ^.^MI + (95) 

2 

<2a„J|Q^ im ^/ 5 ||, 

where estimates (f62|) . ([7T]) and < e < | were used. This, together with 
flMD, yield 

lima n jQ-i/ 5 || =0. (96) 

o — >U 

To prove relation (I92p the following lemma is needed: 

Lemma 3.6. Suppose condition \\f — f$\\ < 5 anc? relation (J96J) /io/d T/ien 

lim = 0. (97) 

<5^0 

Proof. If / ^ then there exists a Ao > such that 

*Ao/^0, (F\ f, /):=£> 0, (98) 

where £ is a constant which does not depend on 5, and F s is the resolution 
of the identity corresponding to the operator Q := KK* . Let 

h(5,a):=a 2 \\Q- l h\\\ Q := KK*, Q a :=al + Q. 

For a fixed number c\ > we obtain 

„2i|/n / ||2 _ / c l j/d j? j- \ ^ / c l 



{ci + sy Jo {ci + sy 



> 7 f\ , 2 [ X °d(FJsJs) = f lF " (f 2 , 6>0. 
(ci + X ) 2 J (ci + A ) 2 



(99) 
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Since F\ is a continuous operator, and ||/ — fs\\ < 6, it follows from ([98]) 
that 

lim (F Xo f 5 , f s ) = (F Xo f, f) > 0. (100) 

Therefore, for the fixed number c\ > we get 

h(6,c 1 )>c 2 >0 (101) 

for all sufficiently small 5 > 0, where C2 is a constant which does not depend 
on 5. For example one may take C2 = | provided that (|98p holds. It follows 
from relation (|96p that 

lim h(5, a n ,) = 0. (102) 
Suppose lim^^o a n 4 / 0. Then there exists a subsequence (5^ — > such that 

aoa„ 5 . > ci > 0, (103) 
where c\ is a constant. By (jlOip we get 

h(5j,a ng ) > C2 > 0, 5j — > as j — ► oo. (104) 
This contradicts relation (|102p . Thus, lim^o a n s = 0. 

Lemma 13.61 is proved. □ 

Applying Lemma [3.61 with a ns = aoq ns , q € (0,1), «o > 0, one gets 
relation (|92l) . 

Lemma 13.51 is proved. □ 

We formulate the main result of this paper in the following theorem: 
Theorem 3.7. Suppose rrii are chosen so that conditions ()50p -(|52 p and ()62p 



hold, and n$ is chosen by rule (|73p . Then 



i™ll<,m„ 5 -y|| = °- (105) 

Proof. From (|57p we get the estimate 

b - < 6>mns || < 2 ( Jfa) + (1 _ j > ( 106 ) 

where J (n) is defined in (|58p . It is proved in Theorem l2.8l that hin^^oo J(n) = 

0. By Lemma [331 one gets n s — ► oo as 5 — > 0, so lim^o J{ns) = 0. From 

Lemma 13.41 we get lim^o -4= = 0. Thus, 

V n s 

lim lly — ut s m || = 0. 
Theorem 13.71 is proved. □ 
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4 Numerical experiments 

Consider the following Fredholm integral equation: 



Ku(s) 



[ e~ st u{t)dt = f{s), s€[0,l] 
J o 



(107) 



The function u(t) = t is the solution to equation (|107p corresponding to 



/(') 



l-(s+l)e- 



-. We perturb the exact data f(s) by a random noise 5, 



8 > 0, and get the noisy data fs(s) = f(s) + 5. The compound Simpson's 
rule (see [I]) with the step size is used to approximate the kernel g(x, z), 
defined in (j5]). This yields 



/c(sj, z)u(z)dz, 



where A;(s, i) := e st , /3j m ^ are the compound Simpson's quadrature weights: 



o( m ) _ o(m) _ 1/3 
Ml — M2 m +1 — 2 m ' 



and for j = 2, 3, . . . , T 







( 4/3 

(m) _ I 2^r, J is even; 
1 |0 , otherwise, 



(108) 



Let 



and are the collocation points: Sj = 4™-, j = 1,2, 

7m := ||(T-T( m ))n||, 
h(s,x,z) := k(s,x)k(s, z) 



,2 m + l. 



and 



Then 



In 



c\ := max max 

180 x,ze[o,i] se[o,i] 



d A h(s, x, z) 



ds 4 



16 
180' 



(109) 



1 / rl 2m + 1 \ 

/ h(s,x,z)ds — \ /3- h(sj, x, z) 



u(z)dz 



dx 



(110) 



< 



ci 

24m 



u(z)dz 



dx < 



Cl 
24m 
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The upper bound ci for the error of the compound Simpson's quadrature 
can be found in pQ. Thus, 



\T — II < 



ci 

24m 



0asm-> oo. 
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Similarly, we approximate the kernel q(x, s) defined in (|64p by the Simpson's 
rule with the step size and get 



||Q-Q {m) ||<^-0asnwoo. 



(Ill) 



Let us partition the interval [0, 1] into 2 m 180, m > 0, equisized subintervals 
Dj, where Dj = j = 1,2, ...,2 m . Then |dj - d,-_i| = ^Iso* 

j = 1, 2, ... , 2 m , and using the Taylor expansion of e st about s = one 
gets 



-si 



e-*-^*[l-t(.-d,_i)]|<£ 



(g ~ rfj) 



< 



2 2r, 



— f (— Y 

180 2 ^ V 2 "* 180 / 



i=o 
1 



«=2 

1 2 m 180 
2 2m 180 2 2 mi80 - 1 



< (s-dj-i) 2 ^-^--!) 
j=0 



< 



1 



2 m 180(2 m 180 - 1) - 2 2m 180 : 
This allows us to define 



Vs G Dj, t £ [0,1]. 



(112) 



K* m u(t) = W e-^ll - t(s - d^ 1 )]u(s)ds. (113) 
f=i ^ 



This, together with condition (|112j) . yields 

2 



* \„.I|2 



\\(K*-K* m )u 



< 



I T,J (e~ st - e- d ^[l - t(s - d^)]) u(t)dt 

.7—1 ^ 

7=1 Jd > 



ds 



2 2m 18 Q2 



2 4m 180 2 



Thus, 



\\K*-K*J\< 



as m — > oo. 



mil - 2 2m 180 
Moreover 

|| (TM -iC^HI < ll(r (m) -T)«|| + || {T-K* m K)u\ 
<-2±-\\u\\ + \\K*-K* m \\\\Ku\\ 



(114) 
(115) 

(116) 



16 

< - — llu 



2 4m 180" " 2 2m 180 



1 „ „ 17 „ „ 
u\\ < —= u 



2 2m 180' 
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Here we have used the constant c\ = 16/180 and the estimate |/c(s,t)| < 
max S)t6[0)1 ] |e~ s *| 



1. Thus, 



17 

K*K\\ < . 

m II - 2 2m 180 



(117) 



To satisfy condition (150[) the parameter rrii may be chosen by solving the 
equation 

Cl di 

To get mi satisfying condition (|5ip . one solves the equation 

17 



2 2m *180 



(119) 



where rj = const > 10. Here we have used the estimate ||T( m< ) — K^.K || < 
r/o? instead of estimate (|5ip . This estimate will not change our main results. 
The reason of using the constant 77 > 10 than of 1 in (jl 19[) is to control the 
decaying rate of the parameter af so that the growth rate of the parameter 
rrii in (|119[) can be made as slow as we wish. To obtain the parameter rrn 
satisfying condition ([52]) . one solves 



2 2m 



(120) 



Hence to satisfy all the conditions in Theorem 13.71 one may choose mj such 
that 



rrn 



max 



ln(2ci/a^ 
41n2 



ln( 
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180(??a^)- 

2 In 2 



2 In 2 



(121) 



where \x\ is the smallest integer not less than x, c\ is defined in (|109p . 
Oj = aoq 1 , ao > 0, q G (0,1). In all the experiments the parameter r\ 
in (|12ip is equal to 10 which is sufficient for the given problem. To obtain 
the approximate solution to problem (|107p . we consider a finite-dimensional 
approximate solution 



< m » : =P m u(z) = £cj m "'%(z), 



(122) 



P m :L 2 [0,1] ^L r 



L m = span{$i,$2,---,^2 m }, 



(123) 
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where {<J?i} are the Haar basis functions (see [9]): $i(x) = 1 Vi £ [0, 1], and 
for j = 2 1 - 1 +p, I = 1, 2, . . . , m, p = 1, 2, . . . , 



2 (l-l)/2 - e [P-i P-V 2 ). 
_o(i-l)/2 - G \V_U1 P). 

0, otherwise. 



(124) 



Let us formulate an algorithm for obtaining the approximate solution to 
(|107p using iterative scheme (fTT]) . where the discrepancy-type principle for 
DSM defined in Section 3 is used as the stopping rule. 

(1) Given data: K, fs, 5; 

(2) initialization : a > 0, rj > 10, q G (0, 1), C > 2, ug, mo = 0, G = 0, 
n = 1; 



(3) iterate, starting with n = 1, and stop until the condition f)133j) below 
holds, 



(a) o n = a g n , 

(b) choose m n = max 



f r in(2ei/q n ) 
\ 4 In 2 



111(17/(180^)) 
2 In 2 



ln(2ci/ v /q^") 



2 In 2 



where ci is defined in (|l(J9p . and a n are defined in (a) 

(c) construct the vectors v s and g s : 

vf^iK^Js,^), i = l,2,...,2 m ", 

g? = i = l,2,...,2 m ", 

(d) construct the matrices A mn and -B mn : 

i,j = l,2,3,...,2 m ™, 

2 m »+l 

(5m»)«: = E '7i mn) (fc(- 5 *i),**>(fc(- 5 ai)*i) ) 
i=i 

i,j = l,2,3,...,2 m ", 



}• 



(125) 
(126) 



(127) 



(128) 



where pi mn ^ and tj^ 171 "^ are the quadrature weights and si are the 
collocation points, 
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(e) solve the following two linear algebraic systems: 



(a n I + A mn )C (mn ' S) = v 5 , (129) 
where (C {mn,S) )i = C^T™^ and 

(a n I + B mn ) 7 ^=g S , (130) 

where ( 7 ( m - <5 )) i = 7 f n "'' 5) , 

(f) update the coefficient (£( m ™' 5 ), $j) of the approximate solution 
u n ,m n (x) in (|122p by the iterative formula: 

< m » = gi^^C*) + (1 - q) C] mn,<5) ^(x), (131) 

3=1 

where 

< mo (x) = 0, (132) 

until 

G n ,m n = qGn^m^+anW^^W < C5 £ . (133) 

Since K is a selfadjoint operator, the matrix B mn in step (d) is equal to the 
matrix A mn . We measure the accuracy of the approximate solution uf^ by 
the following average error formula: 



A^:=^ _ * , tl = , tj = 0mj, j = 2,3,...,99, 

(134) 

where is the exact solution to problem fll07|) . In all the experiments 
we use ao = 1, q = 0.25, C = 2.01 and e = 0.99. The linear algebraic 
systems (|129p and (|130p are solved using MATLAB. The levels of noise: 
5%, 1%, and .05% are used in the experiments. For the level of noise 5% 
the stopping condition is satisfied at m ns = 2. The resulting average error 
is 0.1095. When the noise level 5 is decreased to the level of noise 1%, we get 
the average error Avg = 0.0513, so the accuracy of the approximate solution 
is improved. The parameter m ns for this level of noise is 3, so one needs 
to solve a larger linear algebraic system to get such accuracy. When the 
noise is .5% the average error is improved without increasing the value of 
the parameter m n . In this level of noise we get Avg = 0.0452. The value of 
the parameter m n increases to 4 as the level of noise 5 decreases to 0.05%. 
The average error is improved to 0.0250. Figure 1 shows the reconstructions 
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with the proposed iterative scheme for the noise levels: 5%, 1%, 0.5% and 
0.05%. 

We compare the results of the proposed iterative scheme with the itera- 
tive scheme proposed in j2]: 

u s n = qu s n _ 1 + (1 - q)T~^K*f s , u = 0, a n = a q n , a > 0. (135) 

In this iterative scheme we need to solve the following equation: 

(a n I + A)z = A*f s , (136) 

where 

{A)ij := f f 1 e- s %(t)dtds, i,j = l,2,...,2 m , (137) 

Jo Jo 

(fs)i:= f fs(s)$i(s)ds, i = l,2,...,2 m , (138) 
Jo 

and are the Haar basis functions. In all the experiments the value 

of the parameter m in (|137p and (|138p is 4, so the size of the matrix A in 
(|136|) is fixed to 16 x 16 at each iteration. The reconstructions obtained by 
iterative solution (|135|) are shown in Figure 2. 

In Table 1 we compare the results of the proposed iterative scheme with 
of iterative scheme (|135|) . Here the proposed iterative and iterative scheme 
(|135p are denoted by It\ and H2, respectively. For the levels of noise 5%, 
1%, 0.5% the CPU time of iterative scheme (|135|) are larger than of these 
for the proposed iterative scheme, since at each iteration of iterative scheme 
(|135p one needs to solve linear algebraic system (|136p with the matrix A of 
the size 16 x 16 while in the proposed iterative scheme one only needs to use 
smaller sizes of the matrix A at each iteration. In general the average errors 
of the proposed iterative scheme are comparable to of these for iterative 
scheme (I135p . 

5 Conclusion 

A stopping rule with the parameters m n depending on the regularization 
parameters a n is proposed. The m n is an increasing sequence of the reg- 
ularization parameter a n . This allows one to start by solving a small size 
linear algebraic system (|129p . and one increases the size of the linear alge- 
braic systems only if G n > C5 £ . In the numerical example it is demonstrated 
that a simple quadrature method, compound Simpson's quadrature, can be 
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5 = .5%, m = 4 5 = .05%, m = 4 

Figure 2: Reconstruction of the exact solution u(t) = t using iterative 
scheme (j!35|) 





Table 1: fixed 


vs adaptive 


iterative scheme 










ih 






It 2 




5 


Avg 


m ns 


CPU time 
(seconds) 


Avg 


m 


CPUtime 
(seconds) 


5% 


0.1095 


2 


0.1563 


0.1346 


4 


0.5313 


1% 


0.0513 


3 


0.2188 


0.0339 


4 


0.5313 


0.5% 


0.0452 


3 


0.2344 


0.0300 


4 


0.5469 


0.05% 


0.0250 


5 


0.8281 


0.0206 


4 


0.5313 



28 



used for approximating the kernel g(x, z), defined in (jSJ). Our method yields 
convergence of the approximate solution u & n to the minimal norm solu- 
tion of (pQ). Numerical experiments show that all the average errors of the 
proposed method are comparable to of these for iterative scheme (|135p . Our 
numerical experiments demonstrate that the adaptive choice of the param- 
eter m n is more efficient, in the following sense: the value of the parameters 
m n of the proposed iterative scheme at the noise levels 5%,1% and 0.5% 
are smaller than of the parameter m, used in the iterative scheme f|135[) . 
Therefore the computational time of the proposed method at these levels 
of noise is smaller than the computational time for the iterative scheme 
(|135p . The adaptive choice of the parameters m n may give a large size of 
the matrix A nin in (|129p . since m n is a non-decreasing sequence depending 
on the geometric sequence a n , so the CPU time increases as the value of 
the parameter m n increases. In the iterative scheme (|135j) the size of the 
matrix A in (|136p is fixed at each iteration, so the CPU time depends on 
the number of iterations. The drawback of using a fixed size 2 m x 2 m of the 
matrix A in (|136p at each iteration is: the solution v? n , defined by formula 
(j!35j) . where n = n(5) is found by the stopping rule (|73|) with m n = m Vn, 
may approximate the minimal norm solution on the finite-dimensional space 
L m = span{<3?i, $2> ■ • • , $2 m } not accurately, so that for some levels of the 
noise the exact solution to problem (|10T|) will not be well approximated by 
any function from L m . From Table 1 one can see that the number of basis 
functions used for an approximation of the minimal norm solution with the 
accuracy 0.1095 by the iterative scheme with the adaptive choice of m n is 
four times smaller than the number of these functions used in the iterative 
scheme with a fixed m, while the accuracy is 0.1095 in It\ and 0.1346 in Iti 
(see line 1 in Table 1). 
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